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METHOD FOR PLACING MULTIPLE IMPLANTS DURING A SURGERY 
USING A COMPUTER AIDED SURGERY SYSTEM 

FIELD OF THE INVENTION 

5 The invention relates to placing multiple implants during a surgery. 

More specifically, it relates to aligning multiple virtual implants together 
using a computer-aided surgery system in order to more precisely place the 
actual implants. 

10 BACKGROUND OF THE INVENTION 

There are a variety of computer-aided surgery systems that exist for 
assisting a surgeon in a surgery. Such systems allow the surgeon to view 
the anatomy of a patient before surgery in order to plan the procedure and 
during surgery in order to be guided throughout the procedure. 

15 Surgical navigation is based on displaying, in real-time, instruments 

and patient anatomy to allow unobstructed visualization of the complete 
surgical field. Patient anatomy can be obtained from a number of sources, 
such as CT-scan, digitization, fluoroscopy, etc. Patient bone position and 
orientation are measured in real-time. They are used as references so that 

20 patient movement will not impact the navigation accuracy. Instrument 
position and orientation are also measured in real-time. This is used to 
display the instrument position relative to the patient bone on the computer 
screen. 

Currently, systems allow surgeons to place a virtual implant in an 
25 image, select the implant from a group of virtual implants, and simulate the 
movement of a bone with the virtual implant. The virtual implant is placed 
with respect to its target bone. However, when there is more than one 
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implant to be placed, and these implants are related to each other, it would 
be ideal to align the implants together in an optimal way. 

Moreover, since it is essential to place implants with extreme 
precision, there is a need to provide additional tools to surgeons in order to 
5 allow them to optimize the placements of the implants. 

SUMMARY OF THE INVENTION 

Accordingly, an object of the present invention is to provide additional 
planning tools for surgeons within a computer-aided surgery system. 

10 Another object of the present invention is to align multiple virtual 

implants with respect to each other in an image. 

According to a first broad aspect of the invention, there is provided an 
apparatus for planning a surgery, the apparatus comprising: a display for an 
image representing a patient's anatomy; a database of virtual implants from 

15 which a user selects; a tool for the user to manipulate in order to select the 
virtual implants from the database and place the virtual implants in the 
image at desired locations; and a positioning module for calculating a 
position of a first of the virtual implants with respect to a second of the virtual 
implants and allow the user to align the first and second virtual implants with 

20 respect to each other, for generating relative position data as a function of 
the calculated position, and for sending the relative position data to the 
display. 

Preferably, calculating a position comprises determining how well the 
virtual implants fit along a curve representing an interconnecting member for 
25 the virtual implants. In a preferred embodiment, the surgery is a spinal 
surgery, the virtual implants are at least two spinal implants, and the 
positioning module is for aligning the at least two spinal implants along a 
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curve representing an interconnecting member for the spinal implants. 

According to a second broad aspect of the present invention, there is 
provided a method for placing at least two spinal implants during a surgery 
using a computer assisted surgery system, the method comprising: 
providing an image representing a patient's anatomy; determining a desired 
curve along which the at least two spinal implants are to be placed and 
representing the curve on the image, the desired curve corresponding to an 
interconnecting member for the at least two spinal implants; selecting at 
least two virtual implants from a database of virtual implants to correspond 
to the at least two spinal implants; placing the at least two virtual implants on 
the desired curve in the image by aligning the at least two virtual implants 
with the desired curve while taking into account a position of a preceding 
virtual implant to place a subsequent virtual implant; and placing the at least 
two spinal implants according to the virtual implants in the image using the 
computer assisted surgery system. 

Preferably, determining one of a position and a shape of the 
subsequent virtual implant further comprises using lines to join together the 
virtual implants and align them on the image representing a patient's 
anatomy. Alternatively, determining one of a position and a shape of the 
subsequent virtual implant further comprises calculating a location for the 
subsequent virtual implant based on a location of the preceding virtual 
implant. Determining one of a position and a shape of the subsequent virtual 
implant further comprises constraining the one of a position and a shape 
based on constraints imposed by the preceding virtual implant. 

The method also comprises re-adjusting a position of said preceding 
virtual implant to better position said subsequent virtual implant in order to 
achieve an optimal alignment of all of said virtual implants. 
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Also preferably, the planning module is used with a computer aided 
surgery system and a tracking module. 

According to a third broad aspect of the invention, there is provided a 
computer data signal embodied in a carrier wave comprising data resulting 
5 from a positioning module for calculating a position of a first virtual implant 
with respect to a second virtual implant and allow a user to align the first and 
second virtual implants with respect to each other, for generating relative 
position data as a function of the calculated position, and for sending the 
relative position data to a display. 
10 There is also provided a computer readable memory for storing 

programmable instructions for use in the execution in a computer of the 
method in accordance with the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 These and other features, aspects and advantages of the present 

invention will become better understood with regard to the following 
description and accompanying drawings wherein: 

FIG. 1 is an interface image showing three virtual screws in the 
pedicles; 

20 FIG. 2 is an interface image showing a drill guided by a bull's eye; 

FIG. 3 is an interface image showing a straight line used to align two 
virtual screws; 

FIG. 4 is a block diagram of the apparatus; 

FIG. 5 is a flow-chart according to the method of the present 
25 invention; and 

FIG. 6 is a block diagram of a system using the apparatus. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Throughout this application, the preferred embodiment of the present 
invention will be referred to as a "FluoroSpine™ application" of a 
"Navitrack™ system". While the present invention described in more detail 
5 below is exemplified by a fluoroscopic image-based system, it is not limited 
to the described embodiment and could be practiced with many different 
types of navigation and/or imagery systems. 

The Navitrack™ product is a device used intra-operatively to provide 
the surgeon with additional precise information concerning his maneuvers. 

10 In an imagery based application, the product displays patient anatomy 
(obtained from pre or intra-operative images) and overlays the real time 
position of the surgeon's instruments. In addition, quantitative data relevant 
to the surgery is displayed on the screen. The FluoroSpine™ has the 
objective of giving navigation capabilities for the surgeon's instruments on 

15 intra-operative images. This is particularly useful for simple cases that can 
be operated without the optimal accuracy gained from a more radiation 
intensive scan like CT (computed tomography) or in trauma situations. 

In a preferred embodiment, tracking is done with a POLARIS optical 
tracking system. POLARIS detects infrared light emitted by an active tracker 

20 or reflected by a passive tracker. Three dimensional position in space can 
only be evaluated when a minimum of three spheres or LEDs are seen by 
the camera. 

The principles of navigation and fluoroscopy are based on a tracked 
device placed over the ihtensifier of a C-arm. Plates with lead beads fitted to 
25 this device allow to position markers in known locations in the image. 

Calibration of the image is done by computing the cone of projected 
x-rays. This step allows all virtual objects to be projected accurately on the 
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C-arm images. From the markers, the x-ray volume is computed. Depending 
on the instrument position in the x-ray volume, its appearance may vary. 

More specifically, calibration with the fluoroscope is done in several 
steps. A first shot is taken of an image comprising a plurality of artifacts of 
known relative positions. The computer detects that an image was taken. 
The computer asks the tracking system the position and orientation of the 
clamp and the tracker on the C-arm. The computer then acquires the image. 
Image processing is done to find the positions of the artifacts with respect to 
the known position of the C-arm tracker. The system can then extrapolate 
the position of a cone with respect to the camera reference coordinate 
system. The position of the cone with respect to the clamp can then be 
redefined. 

An x-ray sensitive diode may be integrated into the system in order to 
increase the speed of image detection by the system. The goal is to 
minimize the accuracy reduction caused by patient motion (ex: breathing) 
when the tracking system records the reference tracker position. 

The process for navigated fluoroscopy for spinal operations goes as 
follows. Patient data is first entered into the system. An awl or drill guide is 
calibrated, as well as a screw-driver. When the patient has been prepared, a 
vertebral clamp is placed. Fluoroscopy shots are taken and automatically 
transferred to the Navitrack™ system. Image calibration is performed 
automatically by the Navitrack™ system. The calibration of the shots to be 
used for navigation is then validated. For each necessary screw, the 
surgeon navigates his tool to position a virtual implant which is used to 
determine true implant size. The surgeon then leaves this virtual implant in 
the form of an axis on the navigated images. With the screw-driver, the 
surgeon navigates the real implant to match the planned axis. The outline of 
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this implant is left on the images. When all screws are placed for the 
calibrated fluoroscopy shots, the surgeon takes a snapshot of the desired 
views for intra-operative documentation. Then it is back to the acquisition of 
fluoroscopy shots to operate the next vertebral segment. 
5 The basic technical steps for this type of application are the following: 

• Calibration of the surgeon's instruments to the tracking system 
coordinate system 

• Image acquisition from the fluoroscope by the navigation system 

• Dewarping of acquired image 

10 • Calibration of image to tracking system coordinate system 

• Removal of calibration object patterns from images 

• Navigation of the surgeon's instruments on the fluoroscope images 
Calibration of the surgeon's instruments to the tracking system 

coordinate system: Trackers are included on all the tools that the surgeon 
15 will use during the navigation. In order to properly display the information 

relative to these instruments, it is necessary to establish the mathematical 

relationship between each tracker and its corresponding tool tip position and 

orientation. This procedure is called calibration of the instruments. 

Basically, the tracker's position and orientation is measured by the tracking 
20 system while, simultaneously, the tool tip's position and orientation is in a 

position and orientation known by the tracking system. 

Image acquisition from the fluoroscope by the navigation system: 

Before proceeding with the image acquisition, a calibration object must be 

installed on the fluoroscope. This frame contains active trackers and 2 radio- 
25 transparent plates with a number of radio-opaque beads and/or wires. A 

calibration procedure is designed to establish the bead/wire position relative 

to the active tracker. 
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The Navitrack™ monitors the fluoroscope to detect when a shot is 
taken. At this moment, the position and orientation of all the trackers must 
be measured with the tracking system. In any case, the patient reference 
and calibration object position and orientation must be measured by the 
5 tracking system at the time of the shot to allow dewarping and calibration. 
The image is transferred to the Navitrack™ system via means such as a 
video cable that connects to the fluoroscope video output. 

Dewarping of acquired image: As described in many scientific papers, 
the fluoroscope images may contain distortions caused by optical 
10 characteristics of the system, external magnetic fields, etc. These distortions 
would reduce the accuracy of the navigation, particularly in the image 
s extremities. It is therefore important to remove these distortions. 

The distortion-removing algorithms use some of the beads/wires from 
the calibration object. Since these beads/wires are contained in the image 
15 and placed in a particular pattern, it is possible to determine a mathematical 
transformation that dewarps the pattern in the image. This transformation is 
then applied to the remainder of the image. Naturally, to use this algorithm, 
it is necessary to detect the calibration object beads/wires within the image. 
To minimize operating room time required from the surgeon, this process is 
20 automated. 

Calibration of image to tracking system coordinate system: The 
principle for this calibration is to establish the mathematical relationship 
between the patterns identified in the image (see previous step) and the 
beads/wires true position in space. Since the calibration object is tracked 
25 and the bead/wire pattern position and orientation relative to the tracker is 
known (see image acquisition), the beads/wires true position in space is 
also known. 
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Removal of calibration object patterns from image: Once the image is 
dewarped and calibrated, the calibration object patterns are no longer useful 
to the surgeon and can be removed to insure that the surgeon's view is not 
limited. 

5 Navigation of the surgeon's instruments on the fluoroscope images: 

The surgeon will do the steps described above as many times as needed 
until he has the images required for the surgery. At this point, other objects 
tracked by the system may be superimposed on the images obtained from 
the fluoroscope. While this document describes the navigation as intended 

10 for a pedicle screw insertion in the lumbar spine, a number of other 
navigation tools could be designed. 

To illustrate the principle of the present invention, the following 
example is used. A virtual screw is inserted on the computer display of one 
of the surgeon's tracked tool. This visual representation will be used to plan 

15 how the surgeon will position his next screw and which screw size can be 
used safely. Figure 1 shows a graphic user interface with three virtual 
screws in the image. Once the surgeon is satisfied with the virtual screw 
position, an insertion axis will be displayed oh the fluoroscope images to 
guide the surgeon for the drilling of the holes and the placement of the real 

20 screw. This procedure should be followed for all the screws to be placed on 
vertebrae where the patient reference is placed. When all the screw 
locations seen in the images have been determined and the screws placed, 
the surgeon can return to step 2 and repeat all of the following steps until 
the screws are all inserted. It is possible to save the fluoroscope images 

25 with an overlay of the final screw positions in a standard graphic format. 

The surgeon may place virtual implants on multiple bones. For 
example, the surgeon may place virtual screws on all of the vertebrae in one 
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fluoroscopy image. He places his pointing tool on the chosen entrance point 
for each screw based on his knowledge of the patients anatomy and his 
navigation system. On the screen of the navigation system, he can see the 
virtual screws and adjust the diameter of each screw in order to ensure that 
the screw will not be larger than the pedicle. The virtual screws can be 
aligned with respect to the bones, or with respect to each other. The virtual 
screws can then be fixed in place in the image and graphical tools such as 
targets or bull's eyes can help the surgeon place the real implant in the 
planned area. Figure 2 shows an interface image wherein a bull's eye 
guides the drill of a surgeon for the placement of the screws. 

By placing multiple virtual implants in one image, planning tools allow 
the surgeon to better align the implants. For example, if the goal is to place 
the virtual screws in a straight line, a line can be traced on the screen 
between two virtual screws, allowing the surgeon to properly align the 
subsequent screws and obtain the targeted rectilinear alignment. This can 
be seen in figure 3, where an interface image shows a straight line used to 
align two virtual screws together. Another example is in the case of multi- 
implant constructs, such as for scoliosis, which is an abnormal lateral curve 
of the spine. The surgeon can provide a rod of predetermined shape and the 
navigation system can then illustrate this rod with respect to the screws in 
order to indicate the optimal alignment. Alternatively, once the screws are 
placed, the navigation system can provide the optimal curve for the rod in 
order to facilitate insertion. 

Figure 4 shows an embodiment of the apparatus according to the 
invention. A display user interface 40 receives command data from the user 
via a tool 42 manipulated by the user. The tool 42 can be a pointer which 
touches the screen directly, a computer mouse that controls a cursor on a 
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display, or any other type of tool that allows the user to interface with the 
graphics on the display. From the user interface 40, the user can access a 
database of virtual implants 44. The database 44 comprises all the possible 
sizes and shapes of implants available for the surgery. 
5 The apparatus also comprises a positioning module 46. The 

positioning module 46 can detect where a virtual implant has been placed 
by the user and determine its position in a reference frame. It can also 
calculate where a second virtual implant should be placed with respect to 
the position and orientation of the first virtual implant. If two virtual implants 

10 have been placed, it can determine where a third virtual implant should be 
placed in order to match an alignment of the first two virtual implants. If the 
placement of a third virtual implant is impossible given the anatomy of the 
patient and the position of the first two virtual implants, the positioning 
module 46 can group together the first two implants and move them in 

15 position and orientation together in order to align them with a placement of 
the third virtual implant. The positioning module 46 can also calculate what 
size or shape the third virtual implant should be in order to properly fit with 
the alignment imposed by the placement of the first two virtual implants. The 
positioning module 46 can also adjust individually the first two virtual 

20 implants in order to better co-exist with the third virtual implant It can be 
appreciated that three virtual implants are used to demonstrate the 
capabilities of the positioning module 46 and should not in any way limit the 
scope of the module. Relative position data is exchanged between the user 
interface 40 and the positioning module 46. An image storer 43 comprises 

25 images of the patient anatomy and transmits patient anatomy data to the 
user interface 40 for the user to view and to the positioning module 46 for 
the module to use the data in its calculations and placement operations. The 



WO 2004/017836 



PCT/CA2003/001248 



-12- 



positioning module 46 can select an ideal virtual implant from the virtual 
implant database 44. 

The tool 42 allows the user to group together two or more virtual 
implants and input a desired relative position of the group of virtual implants 
5 with respect to another virtual implant or another group of implants. The 
positioning module 46 can then update the position of either the group of 
virtual implants or the other virtual implant as a function of the desired 
relative position. The positioning module 46 can also update a position of a 
first virtual implant after a second virtual implant has been placed as a 

10 function of a predetermined relative position criteria. The position module 46 
can send relative position data that is graphically or numerically represented 
on the user interface 40. The relative position data can comprise 
information related to the entry point of the virtual implant on the anatomy, 
the orientation of the virtual implant on the anatomy, and depth information 

15 of the virtual implant in the anatomy. 

Figure 5 is a flowchart of the method of the present invention. The 
first step consists in providing an image of patient anatomy 50. This can be 
done pre-operatively or intra-operatively. The next step is to determine a 
desired curve along which the at least three spinal implants are to be placed 

20 and to represent the curve on the image, the desired curve corresponding to 
an interconnecting member for the at least three spinal implants 52. The at 
least two virtual implants are selected from a database of virtual implants to 
correspond to the at least three spinal implants 54. Once selected, the user 
is to place the virtual implant at a desired location in the image 56. This is 

25 done by aligning the at least two virtual implants with the desired curve while 
taking into account a position of a preceding virtual implant to place a 
subsequent virtual implant. Finally, the at least two spinal implants are 
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placed according to the virtual implants in the image using the computer 
assisted surgery system 58. When a subsequent implant is positioned, the 
position of a preceding virtual implant is taken into account in order to place 
the subsequent virtual implant. Automated planning tools are used to 
5 determine the position or shape of the subsequent virtual implant with 
respect to the preceding virtual implant. 

To illustrate the method, the case of a spinal intervention is used. If a 
first virtual implant is a pedicle screw, the surgeon selects it from the 
database and places it in the image. The second virtual implant can also be 

10 a pedicle screw. However its placement is determined based on the position 
and orientation of the first virtual pedicle screw. If a straight alignment is 
desired, then the second pedicle screw is placed so as to obtain a straight 
line from the first pedicle screw to the second pedicle screw. If a third virtual 
implant is a rod to be fitted on the screws, the shape of the rod is 

15 determined based on the placement of the first two pedicle screws. If the 
anatomy is limiting and doesn't allow many configurations or shapes for the 
rod, then the virtual rod is placed in the image according to the constraints 
of the anatomy and the virtual pedicle screws are then adjusted based on 
the position of the rod. 

20 Therefore, lines are used to join together the virtual implants and 

align them on the image. The method also comprises calculating a location 
for the subsequent virtual implant based on a location of the preceding 
virtual implant and re-adjusting a position of a preceding virtual implant to 
better position the subsequent virtual implant. The last step of the method 

25 consists in placing the real implants based on the position of the virtual 
implants 58. 

In an alternate embodiment, other interventions like intramedullary 



WO 2004/017836 



-14- 



PCT/CA2003/001248 



nailing may be addressed with these planning tools. In this case, the 
planning tools can be used to align the intramedullary rod with the proximal 
and distal nails during a fracture correction surgical intervention in order to 
allow the least invasive method without the presence of a cumbersome 
5 mechanical jig. Once the tracked rod is placed in the bone, virtual nails with 
graphic aiming devices can be placed to orient the positioning of the real 
implants such that they can pass through the holes in the rod (normally not 
visible to the surgeon). Additionally, in the case of a multi-fragment fracture, 
similar planning methods could be used to reposition virtual fragments 

10 obtained from intra-operative imaging and apply virtual nails or other 
relevant implants. The potential interventions cover all surgeries with 
multiple implants including but not restricted to orthopedics (spine, hip, 
knee, shoulder, etc) and ear-nose-throat (ENT). 

In a preferred embodiment, the planning module 45 is used with a 

15 computer assisted surgery system 48 and a tracking module 47, as 
illustrated in figure 6. 

It will be understood that numerous modifications thereto will appear 
to those skilled in the art. Accordingly, the above description and 
accompanying drawings should be taken as illustrative of the invention and 

20 not in a limiting sense. It will further be understood that it is intended to 
cover any variations, uses, or adaptations of the invention following, in 
general, the principles of the invention and including such departures from 
the present disclosure as come within known or customary practice within 
the art to which the invention pertains and as may be applied to the 

25 essential features herein before set forth, and as follows in the scope of the 
appended claims. 



